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Analytic Hierarchy Process (AHP), subjective probabilities, the entropy concept, and Maxi 
Agreement Heuristic (MAH) to enhance the decision maker’s intuition in evaluating a set of ESRs. 
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I. CONSENSUS RANKING APPROACH 
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Organizational Benefits: 
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Figure-1: Consensus Ranking Approach 
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Number of Subcriteria for the i-th Stakeholder (i = 1,2, . 


Given that i=l through N, represents stakeholders^ this study Has utilized 6 stakeholders 
including: Safety, Systems Engineering, Program office, Operations, Reliability, and PICB. The Project 
Success factor for the m-th ESR is: 
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setting K — \! e m „ Y , we achieve 0 < e(/? i; ) ^ 1 • This normalization is necessary for meanlhgful 
comparisons. In addition, the total entropy is defined as: 



The smaller e(p v ) is, the more information is transmitted by the j-th subcriteria in the i-th 
stakeholder and the larger e(p v ) , the less information is transmitted. When e(p tJ ) = = \nq, the j-th 



The more different the subjective probabilities, p", are, the larger f v , and the more important the j-tl 
subcriteria in the i-th stakeholder is. When all the subjective probabilities, p ” , are equal, then f i} = 0 
In order to calculate the overall importance weight of the j-th subcriteria in the i-th stakeholder, , th 
intrinsic weight, f ijy is multiplied by the subjective weight, w^and then the product is normalized: 
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that the best estimate of w is the one associated with the maximum eigenvalue (Jmax) of the matrix A. 
Since the sum of the weights should be equal to 1.00, the normalized eigenvector is used. Saaty’s 
algorithm for obtaining this w is incorporated in the software Expert Choice. 
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In the standard practice of AHP, when more than one DM is involved, the linear composite 
concept is extended across various DMs. In this project the Maximize Agreement Heuristic is used to 
aggregate individual GSWT committee member preferences. 







Similarly, the sum of a y for each ESR across all rows represents the negative preference vector, 
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Table-2: ESR Rankings Using the Current Approach 
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Figure-2: Classify and Categorize ESRs (Initial Phase) 

































Figure-3: Categorize Non-Safety Impact ESRs into 20, 2M, and 2E 




Figure 4: Identify Stakeholders (Initial Phase) 




Table-4: Identify Subcriteria and Their Importance Weights for each 

Stakeholder Group 

STAKEHOLDER: Safety - CRITERIA: Safety 
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Table-5: Identify Subcriteria and Their Importance Weights for each 

Stakeholder Group 

STAKEHOLDER: Systems Engineering — CRITERIA: Supportability 
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Table-6: Identify Subcriteria and Their Importance Weights for each 

Stakeholder Group 

STAKEHOLDER: Program Office — CRITERIA: O&M Cost Savings 
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Impact | Sab-code | Cost >;^|1| 

1 OL-PEO TE: Ability 10 Usc L®» People 

1 OL-TSK TE : Ability to Simplify/Eliminate Tasks 0.208 

1 OL-TIM TE: Ability to Reduce Time 0.131 
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Table-10: Develop the Importance Weight of each Stakeholder (Round 1) 
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Table-11: Develop the Importance Weight of each Stakeholder (Round 2) 
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Tabale- 16 : Identify the Individual Project Success Factor of each ESR and Develop 
Rankings and Develop Consensus Ranking of ESRs 
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Table-17: Ranking of Tactical ESRs Using Consensus Ranking Approach 
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Table-18: Ranking of ESRs with Safety Impact (2S) 


1 


8 


III 

0.605 

1 919*0 

0.576 

0.570 

0.569 

0.563 

0.544 

O 

vr> 

o 

0.550 

0.548 

0.540 

0.521 | 

ro 

o 

0.502 

00 

Nf 

d 

1 0.549| 

:lil 

W 

|^> 

i 

152,000 

169,077 | 

$ 

» 

426.400 

490,783 


524.768 

540,768 

562,768 

582,964 

600.964 

630.964 

§ 

00 

899,993 


!|i 

40,000 | 

oootu 

17,077 | 

1 

175,060 

8 

5 

20,200 

13,785 

000*91 

22.000 

20.196 

000*81 

30.000 

240,029 

29.000 

I 

i|li 

CO 

rs 

CO 

rs 

CO 

CS 

CO 

CM 

CO 

CN 

CO 

rs 

CO 

rs 

CO 

rs 

CO 

rs 

CO 

rs 

CO 

rs 

CO 

rs 

CO 

rs 

CO 

rs 

CO 

rs 


1 

P 

p 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

P 

§ 

l! 

K16012 1 

K.15998 

K15642 

1C 15470 

3 

K15504 

K.16045 

X 

2 

3 

i 

K.15697 

K15674 

& 

|g 

5 

K15747 

K15936 


i 

»n 

VO 

On 


On 

O 

fS 


On 

rs 

s 

rs 

a 


00 

O 






O 


s 

9 

m 

£ 

V 

u 

e 

o 

o 

s 

s 

.9 

o 


TD 


£ 

p2 

W 

o 

W) 

9 

2 

9 

2 


ON 

A 

3 


■ 

0.576 

0.573 

*n 

r- 

in 

• 

© 

oj^rCh# 

26.942 

81,942 


1 

26.942 

55,000 

1 

® 

If 

8 

8 


%• 

ff§:: 

£ 

£ 


tt-SR: 

spf 

r* 




K15645 

i. 

2 


i 


VO 



to 

m 




Table-20: Ranking of ESRs Related to High Maintenance/Design Issues (2M) 
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